Lyapunov analysis captures the collective dynamics of large chaotic systems 
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We show, using generic globally-coupled systems, that the collective dynamics of large chaotic 
systems is encoded in their Lyapunov spectra: most modes are typically localized on a few degrees of 
freedom, but some are delocalized, acting collectively on the trajectory. For globally-coupled maps, 
we show moreover a quantitative correspondence between the collective modes and some of the so- 
called Perron-Frobenius dynamics. Our results imply that the conventional definition of extensivity 
must be changed as soon as collective dynamics sets in. 
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A common way of characterizing chaos is to measure 
Lyapunov exponents (LE), which quantify the infinites- 
imal rate(s) of divergence of trajectories in phase space, 
and to represent them arranged by decreasing order in a 
spectrum. For large, spatially-extended, dissipative sys- 
tems, Ruelle conjectured that if Lyapunov spectra ob- 
tained at different system sizes collapse onto a single 
curve when the exponent index is rescaled by the sys- 
tem's volume, then chaos is extensive This was in- 
deed shown to hold for generic models of spatiotempo- 
ral chaos in one space dimension 0]. However, in higher 
space dimensions or for globally-coupled systems, the ex- 
tensivity of Lyapunov spectra may be questioned. In- 
deed, it is now well known that such large chaotic sys- 
tems, in contrast to their one-dimensional counterparts, 
generically show non-trivial collective behavior, in which 
macroscopic observables evolve periodically, quasiperiod- 
ically, or even chaotically in time without exact synchro- 
nization of microscopic degrees of freedom 0, 0| . If such 
behavior is encoded in the Lyapunov spectrum, then the 
above definition of extensivity cannot hold, because col- 
lective modes are by definition intensive. Beyond this, 
knowing whether emerging macroscopic behavior can be 
captured by traditional "microscopic" Lyapunov analysis 
(and if yes, how and to what extent) is important for our 
general understanding of dynamical systems. 

Few previous works approached this question, with 
contradicting conclusions: For globally-coupled chaotic 
maps it was argued that one needs finite- amplitude 
macroscopic perturbations to quantify the instability of 
collective chaos 0, suggesting that traditional Lya- 
punov analysis cannot capture such macroscopic dy- 
namics. On the other hand, Nakagawa and Kuramoto 
0, studying globally-coupled limit-cycle oscillators, have 
pointed at the possible connection between some LE and 
collective dynamics, although they did not offer any crite- 
rion to distinguish, or even define, such collective modes. 

In this Letter, we present evidence that the collective 
dynamics of large chaotic systems is encoded in their Lya- 
punov spectra in a rather simple manner: Whereas most 



modes collected in the spectrum are typically localized 
on a few degrees of freedom, some specific modes are 
delocalized, acting collectively on the trajectory. Our re- 
sults rely on the investigation of the covariant Lyapunov 
vectors (CLV) associated with the exponents. Working, 
for simplicity, on globally-coupled systems, we show that 
strong finite-size effects coupling microscopic and macro- 
scopic modes have to be overcome to unravel the under- 
lying low-dimensional collective dynamics. For globally- 
coupled maps, these conclusions are strengthened by a 
direct study of the collective dynamics via the so-called 
Perron-Frobenius (PF) operator: We show a quantitative 
correspondence between some LE and CLV of the PF dy- 
namics and the collective modes present in the usual Lya- 
punov analysis. We finally discuss how our results imply 
that the conventional definition of extensivity must be 
changed as soon as collective dynamics sets in. 

Covariant Lyapunov vectors span the subspaces of the 
Oseledec decomposition of tangent dynamics, and thus 
provide intrinsic directions of growth of perturbations 
for each LE A (i) 0. It is only recently that CLV be- 
came numerically accessible for large systems Q and 
they must not be confused with the Gram-Schmidt vec- 
tors customarily used when calculating LEs, which are 
not intrinsic and usually bear no physical meaning. The 
average localization of CLV can be quantified by 
calculating the so-called inverse participation ratio [10( 
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ing along the trajectory. (Here, the CLV are normalized 

with the L2 norm E l l l; P ) | 2 = L ) Since Y 2 ] is J ust 
the inverse average number of degrees of freedom partic- 
ipating in «w, collective (delocalized) and microscopic 
(localized) modes are denned as those satisfying, respec- 
tively, Y<z ~ 1/N and Y% ~ const, in the N — * oo limit. 

To start, we consider, following Q, a simple system 
of N globally-coupled limit-cycle oscillators known for 
exhibiting non-trivial collective behavior: 

W t = W l -(l + ic 2 )|lF l | 2 TF l + X(l + ic 1 )((VF)-lF l ), (1) 



where Wi are complex variables and (W) 
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Here we focus on a collective chaos regime where in- 
dividual oscillators, while behaving erratically, arrange 
themselves, in the complex plane, on a curve undergoing 
stretching and folding along time (Fig. QJi) . The density 
of oscillators along this fractal-like curve is a complicated 
function with many peaks, reminiscent of the invariant 
measure of single chaotic maps (Fig. [TJd). In this regime, 
the evolution of collective variables such as (W) takes the 
form of a weakly chaotic modulation of some quasiperi- 
odic signal (Fig. [Hi). This type of dynamics is similar to 
some small systems, made of, e.g., a couple of nonlinear 
oscillators with incommensurate frequencies 

We calculated LE and the associated CLV for differ- 
ent system sizes (Fig. [2]), using the algorithm described 
in [9J. Lyapunov spectra, plotted as functions of the 
rescaled index h = (j—0.5)/N, are composed of two main 
branches near 0.05 or near —1.25, reflecting the basic 
dynamics of individual (uncoupled) oscillators (Fig. [2^). 
Both branches show a systematic drift as increasing N 
and thus the Lyapunov spectra do not collapse entirely 
onto a single curve (inset of Fig.[2ji). Similarly, the aver- 
aged participation ratios Y 2 of the CLV form two groups 
largely independent of N, corresponding hence to local- 
ized vectors, except the edges of the two groups (Fig.[2p). 
Indeed, the parametric plots Yg vs reveal that at 
both ends of the spectra, as well as near zero exponents, 
Y 2 decreases with N, suggesting the possible presence of 
delocalized modes (Fig. [2p). 

Focusing first on near-zero exponents reveals the ex- 
istence of two numerically-null exponents (A ~ 10~ 5 at 
our numerical resolution) with Y2 oc 1/N, i.e. delocal- 
ized modes (solid symbols in Fig.[3K). Nearby exponents 
"cross" the zero line smoothly as N is varied, and their 
Y 2 are essentially independent of N, except when they 
come accidentally close to the two collective zeros, in 
which case the algorithm cannot resolve well this degen- 
eracy. Among the most negative exponents, only the last 
two appear delocalized when large-enough system sizes 
are considered (Fig. [3};) 12]. Finally, one has to explore 
even larger system sizes to see that the first mode is actu- 
ally delocalized: for TV > 10 6 , Y% starts decreasing faster 
(Fig. [3)3). The scaling of left part of the distribution 
of instantaneous Y 2 values indicates that asymptotically 
Y 2 cx 1/N (Fig. [5H). 

The participation ratio Y2 is only a global indicator 
which does not provide information about the actual 
structure of the CLV. We have investigated this struc- 
ture in a careful study. While details will be published 
elsewhere [Hi], we only report here the main findings. Mi- 
croscopic, localized, modes, are each localized on two 
nearby oscillators. The vector of the chaotic collective 
mode typically moves some of the peaks in the oscillator 
density along the curve on which it is located in the com- 
plex plane. Different peaks are moved at different times, 
increasing thus the global disorder. On the other hand, 
the vectors of the two delocalized negative modes tend to 
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FIG. 1: Collective chaos in globally-coupled limit-cycle oscil- 
lators [Eq. 0] with cx = -2.0, c 2 = 3.0, K = 0.47, N = 10 7 . 
(a) Typical snapshots of the population in the complex plane; 
note the stretching and folding of the supporting line, (b) 
Typical distribution p(6 = arg W) for a configuration where 
no fold is present, (c) Time series |(W)|. 



adjust the width of these peaks, increasing synchroniza- 
tion. As for the two collective zero modes, their vectors 
are difficult to identify due to the degeneracy of the ex- 
ponents, but they can be assigned to a global change of 
phase and to a translation along their trajectory of all 
oscillators, two "natural" neutral modes. 

To sum up the set of collective LE correspond to what 
one would expect from the observed global dynamics in 
Fig. Hp, and the action of the associated CLV also corrob- 
orates this view. Although strong finite-size effects cou- 
ple macroscopic (delocalized) and microscopic (localized) 
modes, it is likely that, for the case studied above, no 
other collective mode exists, although we cannot exclude 
the emergence of other ones (in particular very weakly 
chaotic) at still larger sizes than those probed here. Thus, 
conventional Lyapunov analysis, supplemented with the 
calculation of covariant vectors, is able to capture the col- 
lective behavior of a large chaotic system. To investigate 
the generality of this finding, we now turn to systems of 
globally-coupled maps of one real variable. 

In globally-coupled systems of identical units, one can 
look "directly" at the infinite-size limit by studying the 
evolution of the instantaneous distribution function of 
the values taken by the units, which is governed by the 
Perron-Frobenius operator. Although this is a difficult 
analytical task, a numerical approach, e.g., by using finer 
and finer binnings of the support of the evolving distribu- 
tion, is in principle possible. In the case described above, 
this is made difficult by the fact that this support is the 
complex plane fractal-like curve described in Fig.[T]a,. For 
globally-coupled maps of a real variable, however, the 
support is typically a bounded interval of the real axis, 
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FIG. 2: (color online) Spectra of A vs. h (a), Yi vs. h (b), 
and Yi vs. A (c) for the system depicted in Fig.[T]for different 
sizes A". Insets: close-ups of the positive branch. (Arrows 
indicate increasing A''.) 



so that a numerical integration is accessible. As a matter 
of fact, previous work on globally-coupled noisy logistic 
maps 
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15l | has provided partial evidence that the LE 
of the PF dynamics are related to the collective dynam- 
ics, but no direct link was ever shown. We thus consider 



the same system: 



(l-K)f(xl) + K(f(x))+C 



(2) 



where f(x) = 1 — ax 2 is the logistic map (here we use 
a = 1.57, in the one-band chaos regime) and £* is a delta- 
correlated noise. For an infinite system, the evolution 
of p t (x), the instantaneous distribution of x values, is 
governed by the following nonlinear PF equation 



(,;) 



with F*(y) 



(l-K)f(y)- 



-x)p t (y)dy 
K J f{z)p\z)dz , 



(3) 



where /?n(£) is the noise distribution function. To evolve 
properly both Eq. ([3]) and its tangent space dynamics 
requires to keep the support of p t (x) within [—1, 1], the 
invariant interval of the logistic map, and to have well- 
defined derivatives of pn(£), a f &c t overlooked by [3, EH- 
We therefore use the bounded and differentiable noise 
Kumaraswamy distribution /On(C) = 15£' 2 (1 — £' 3 ) 4 with 
£' = (C/cr + l)/2 G [0, 1], so that £ G [-a, a]. We focus 
on the collective chaos regime observed for K — 0.28 and 
a noise level a = 0.1, in which local dynamical variables 
tend to synchronize but are weakly scattered by micro- 
scopic chaos and noise ID, 16j |. 



We first describe the outcome of the conventional Lya- 
punov analysis. The (A,y2) spectrum of small-size sys- 
tems (Fig. Hk) reveals that the first few (positive) modes 
show signs of being delocalized. Calculating only the 
first three in large systems shows that the first mode is 



0.02 


-0.02 



10 



10~ 



x if 



GO 
>> 



>> > 



io >\2 ? n *« 

■ " a ■ v 



N 



10 



10' 



10 



10 





10 

(c) 



10 



0.14 
0.12 
0.1 
0.08 

10" 1 
10" 2 



(b) 

















D D 












N 



o 


1 




O o o 

n o- 
— 1 L 




-Y 




1 


o 1 

o - 

N 


2 4 

10 10 


10 6 10 


(d) 





12 3 4 

10 10 10 10 



10 




FIG. 3: (color online) Size dependence for the system depicted 
in Figs. [T]and[2] (a) A and Y2 vs N around A = 0. The two 
modes with A = are shown in filled symbols, (b) same as (a) 
for the first 3 modes, (c) Y2 vs N for the last four modes (d) 
Distribution of instantaneous Y2 values for the first mode vs 
N. Inset: rescaling showing that eventually Y2 oc 1/N. [The 
dashed lines in (a,c) correspond to the power-law Y2 ~ 1/Af.] 



indeed delocalized, while the following ones are localized 
(Fig. 2J;) . Similar calculations do not indicate that any of 
the last modes is actually delocalized (data not shown). 
Thus, conventional Lyapunov analysis of finite systems 
seems to detect the presence of only one collective mode 
with exponent ~ 0.081 (Fig.QJ)). 

We now turn to our investigation of the PF dynamics. 
The evolution of p(x) matches that of large collections 
of maps for a large number of timesteps (not infinite, 
due to finite-size and finite-binning effects), when taking 
for initial condition of the PF dynamics a (smoothed) 
instantaneous distribution of maps. The Lyapunov spec- 
trum of the PF dynamics contains only one positive ex- 
ponent App ~ 0.0815, in remarkable agreement with the 



"finite-size" collective exponent A 



(i) 



calculated above 



(i) 



(Fig. [4)3). Moreover, the CLV associated with A 
and App share the same structure. In Fig. QJl, we show 
snapshots of each vector at timesteps carefully chosen so 
that the two distributions (p(x) from the PF dynamics 
and the distribution reconstructed from a large- N simu- 
lation) coincide very well (top panel). Both vectors exert 
the same shift in distribution Sp(x) (lower panel). Thus, 
the collective mode appearing in the conventional Lya- 
punov analysis is the first Lyapunov mode of the PF dy- 
namics. However, the PF dynamics possesses infinitely- 
many modes, all negative except the first one in our case, 
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FIG. 4: (color online) Lyapunov analysis for globally-coupled 
noisy logistic maps [Eq. (J2J] with a = 1.57, K — 0.28, a = 
0.1 and the corresponding PF equation [Eq. Ip}]. (a) (Y2,A) 
spectra for different N. The vertical lines indicate the location 
of the first two LE of the PF dynamics, (b) First three LE vs 
system size N (symbols) and for first PF LE (dashed line) . (c) 
Y2 vs N for the first three modes [same symbols as in (b), the 
dashed line indicates the power law Y2 ~ (d) Typical 

snapshot for the distribution p(x) (top) and for the first CLV 
Sp(x) (bottom). Solid lines and circles are the results from 
PF and maps of size N = 10 7 , respectively. 



identified, in one case at least, one such collective mode 
with a Lyapunov mode of the PF dynamics. Further re- 
sults will be needed to strengthen these findings. We have 
studied other globally-coupled systems and reached sim- 
ilar conclusions , but the strong "finite-size" coupling 
between microscopic and collective modes reported here 
makes it difficult to build a reliable asymptotic picture. 
We believe our conclusions should also hold for locally- 
coupled systems, which generically exhibit non-chaotic 
collective behavior, but first attempts in this direction 
have revealed even stronger size effects in this case. 

At any rate, our results already imply that the conven- 
tional criterion usually adopted to prove the extensivity 
of (microscopic) chaos in large dynamical systems has to 
be changed. Collective modes should be excluded from 
the usual rescaling of Lyapunov spectra at least, but this 
may not be enough in practice, since microscopic modes 
are strongly influenced by neighboring collective modes 
through the finite-size effects reported above. Thus, an 
operative definition of chaos extensivity using Lyapunov 
analysis implies a quantitative understanding of these 
finite-size effects, a task left for future work. 

We acknowledge fruitful discussions with A. Politi and 
M. Sano. This work is supported in part by JSPS. 



and even the second one, given at A PF ~ —0.49, is not 
detected by conventional Lyapunov analysis, at least up 
to N = 131072. In fact, PF modes with negative LE 
may not necessarily be present in the microscopic Lya- 
punov analysis. This is trivially true in the special case 
K = (no coupling), where all conventional Lyapunov 
modes are localized with the same, positive exponent, 
while PF dynamics shows infinitely many negative expo- 
nents which can be seen as superpositions of 0{N) inde- 
pendent microscopic modes. Whether this zero-coupling 
situation extends to coupled maps — and thus would ex- 
plain how some PF negative modes could remain unseen 
in conventional spectra — is a difficult question which 
should be treated at a more mathematical level. We note 
finally that at least some negative collective modes ap- 
pear in conventional Lyapunov analysis, as shown for Eq. 
(P) , while positive PF modes are probably all present be- 
cause they cannot be superpositions of independent mi- 
croscopic modes. (Such perturbations would not grow.) 

To summarize, we have shown, using generic globally- 
coupled systems, that conventional Lyapunov analysis 
can capture the collective dynamics of large chaotic sys- 
tems through delocalization of CLV. We have found col- 
lective Lyapunov modes which are delocalized for large 
but finite system sizes, and clearly related to the observed 
macroscopic dynamics. This implies that there is no gen- 
eral need for finite-amplitude perturbations as claimed 
in some earlier studies |5|, lfj| • Moreover, we have directly 
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